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Description 

Background of the Invention 

This invention relates to video editing, and more 
particularly to an operator interface for a video editing 
system that provides enhanced visualization and Inter- 
active control of video sequences during the editing 
process. 

Presently, the video editing equipment that Is used 
tends to interpose a lot of numbers and technical con- 
siderations between an artist attempting to create a vid- 
eo program and the video images that must be manip- 
ulated in the course of creating that program. Cutting 
and splicing film on a film editor provided a visual and 
spatial dimension to the temporal aspect of a film. Thus 
far, efforts to bring this same sort of interactive conven- 
ience and "fee!" to the video tape editing process have 
met with limited success, although considerable 
progress has been made. 

U. S. Patent 4,937,685 to Barker et al for a "Method 
of Display Presentation for Video Editing" discloses an 
apparatus and method for video composition that 
presents ah operator with video labels at each end of 
each video blip. \^dg5]agdls^re low resolution digital 
^representations of a frame of actual video. Because 
Tffee^video labels contain much less total information 
t]/an the underlying video frame that they represent, 
iney can be more readily stored and retrieved than ac- 
ftual video images can be, and are therefore used as sur- 
rogates for the real video images during some parts of 
the editing process. 

In the system described in the Barker et al '585 pat- 
ent, the operator can view a clip of video or a transition 
between two clips of video on a main monitor in an "end- 
less loop" repeating display A set of four label display 
screens show the above described video labels of the 
clips currently underactive manipulation. A plurality of 
additional smaller display monitors are provided in ver- 
tical pairs for viewing a series of pairs of video labels 
representing a series of clips currently arranged to be 
viewed in sequence. 

In the Barker et al '685 system, the operator is able 
to manipulate the video labels instead of the video itself, 
thereby permitting the re-arrangement of the video clips 
virtually, even though the actual video is still stored in 
its original order, thus minimizing the need for fast ac- 
cess to the video itself. When rapid access to the actual 
video is required, it is achieved by recording multiple 
copies of the same video clip on multiple video tape re- 
corders (VTRs) and positioning each of the VTRs at dif- 
ferent locations on the clip, so that one VTR is always 
close to any desired point of interest. 

While the Barker et at '685 system provides the op- 
erator with video labels at the beginning and end of clips, 
a sequential continuous loop display of the active clip 
and a readout of the duration of the active clip, it does 
not provide any graphic display of the clip's length or the 



rest of its internal contents. 

A video editing software system called 'Media Mak- 
er" is produced by Macromind Inc.. 410 Townsend St.. 
Suite 408. San Francisco. California. This system dis- 

5 plays simple timelines that indicate the length of video 
sequences as they are being manipulated, but these 
simple timelines do not provide any visual cues as to the 
contents of the video sequences. 

In connectton with another aspect of the prior art, 

10 control of the displayed location on a video tape in a 
video tape recorder has traditionally been accomplished 
with two rotatable wheels or knobs or a single one which 
operates in two modes, depending on the position of a 
mode control switch. In the first mode of operation, ro- 
tational motion of the wheel or knob is interpreted as 
positional distance. In the second mode of operation, 
the same rotational motion is interpreted as velocity 
magnitude control. U. S. Patent 4,988.982 to the present 
inventor for "Touch Pad Machine Control", hereby incor- 

20 porated by reference, describes this prior art in its 
"Background of the Invention". The specification of the 
4,988,982 patent describes an alternative approach to 
VTR control that relies on a touch pad with different re- 
gions, one of which is devoted to position control, an- 

25 other of which is devoted to velocity control. 

Fernseh und KInoTechnik, Vol. 45, no. 5. 1991 , Hei- 
delberg. DE. Krleg P.. "Multimedia-Computer und die 
Zukunft des FilmA/ideoschnitts", pages 252-254, 256 
and 258 discloses a multimedia computer providing, in 

30 Figure 5 thereof, decimated frames to identify different 
video clips. 

Summary of the Invention 

35 It is an object of the present invention to provide an 
operator interface for a video editing system that dis- 
plays a graphic representation of a video sequence to 
give the operator a visual sense of the content of the 
sequence, as well as its length. 

40 According to this invention there is provided a meth- 
od for representing a video sequence visually and in 
terms of its length as claimed in claim 1 herein. Various 
features of the invention are defined in the appended 
claims. 

45 In the invention, as the video sequence is first proc- 
essed into the system, a small but representative sam- 
ple of each video frame is saved in a local memory, while 
the video itself Is stored in mass storage. The frame 
samples are used in the display to provide a video pic- 

50 torial timeline of the underlying stored video. 

The subject matter of the present invention is par- 
ticularly pointed out and distinctly claimed in the con- 
cluding portion of this specification. However, both the 
organization and method of operation, together with fur- 

55 ther advantages and objects thereof, may best be un- 
derstood by reference to the following detailed descrip- 
tion and accompanying drawings. 



2 



3 



EP 0 526 064 B1 



4 



^ Brief Description of the Drawings 

FIG. 1 is a screen view of a portion of the operator 
interface of the present invention; 
Fl G. 2 is a simplified block diagrann of the video ed- 
iting system; 

FIG. 3 is a block diagram representation of how a 

video pictorial timeline is created; 

FIG. 4 is a block diagram representation of howtime 

marks and cursors are generated; 

FIG. 5 is a block diagram representation of how a 

machine control window operates; 

FIG. 6 illustrates an implementation of a machine 

control window utilizing a potentiometer instead of 

a mouse as the means for operator input; 

FIGS. 7A and 7B illustrate the process of marking 

and time-aligning two video sequences to achieve 

time alignment between them; 

FIG. 8 Is an illustration of three simple timelines and 

two video pictorial timelines in a single Workspace; 

and 

FIGS. 9A to 90 are a simplified logic flow diagram 
of a portion of the operator interface for a video ed- 
iting system in accordance with the present inven- 
tion. 

Detailed Description 

The display shown in FIG. 1 is part of a user inter- 
face implemented on an Apple Macintosh computer. It 
utilizes window and cursor control approaches that are 
somewhat similar to the normal Macintosh (TM) inter- 
face, but instead of the normal Macintosh keyboard this 
system employs a keyboard that has colored keys. That 
keyboard resembles the keyboards and color codings 
that are somewhat standard in the television post-pro- 
duction editing equipment industry. 

The screen shown in FIG. 1 is divided into four 
. quadrants. The upper left quadrant contains most of the 
features associated with the present invention and will 
be discussed In detail below. The upper right quadrant 
is a Workspace 15 that has a vertical layers axis 25 
along its left side and a horizontal time axis 24 along Its 
top. The scale on horizontal time axis is variable, allow- 
ing the operator to select the time span that will be dis- 
played. 

The Workspace 15 shows, for a portion of a pro- 
gram being created, the sequential arrangement of vid- 
eo segments or clips, as well as the relative synchroni- 
zation of those video clips (layers) that are to play at the 
same time. The Workspace 1 5 is divided into two parts, 
a background area 33 on the bottom and a layers area 
32 on top. The background area 33 is used for basic 
editing that only involves a linear arrangement of video 
sequences with cuts or dissolves. The material that ap- 
pears here may form the background for a more com- 
plex event that is organized into layers in the layers area 
32. In the background area 33, video segments are 



shown in two ways: they either appear as a wide time- 
line, such as the one whose dark portion is labeled 'Bik" 
and whose shaded portion is labeled "8 Vtr", or as a title, 
such as the darker shaded timeline above the 'B Vtr" 

s timeline, the one with the sloping leading edge that rep- 
resents a transition. Audio sources associated with the 
wide timeline appear as narrow timelines beneath it. 

In the layers area 32, video segments are shown as 
simple, narrow timelines 21 , Transitions or effects in the 

JO layers area 32 are shown as separate individual time- 
lines. Layers in the Workspace 15 that are currently in- 
cluded in the edit are shown shaded, as layers L3 and 
L2 are, while layers that are not currently included in the 
edit are shown in white (unshaded), as layers L5 and L4 

IS are. 

The lower right quadrant of the screen shown in 
Fl G. 1 contains a Text Timeline 35 that provides a textual 
display of the composite timeline being developed in the 
Workspace 15 areas 32 and 33. The lower left quadrant 

20 of the screen displays an Edit (Decision) List 36 (EDL) 
of editing previously performed. The Edit List 36 area 
can be scrolled to look at old versions of edits or at a 
partial result of the current editing process being per- 
formed in the Workspace 15 areas 32,33. As work is 

2S completed in the Workspace 15 areas 32,33, it is ap- 
pended to the current Edit List 36 at the location of ver- 
tical reference line 29. 

As can be seen in FIG. 1, the first ten seconds of 
an edit is shown in the Workspace 15 layers area 32, 

30 the background area 33 and the Text Timeline 35. At the 
left side of the Workspace 15, five seconds of pre-roll 
time for the switcher is shown. Following that, in the 
background area 33 and in the Text Timeline 35, two 
seconds of black background is shown. Audio 1 (A1) 

3S and Audio 2 (A2) are also black during this time. Indicat- 
ing a silence on the audio tracks associated with the 
black video. The interval of black video and silent audio 
is shown in the Text Timeline 35 as the second entry. "0 
CUT BLK". The first entry in the Text Timeline 35 indi- 

40 cates that this recording (RECD) will use Audio .1 , Audio 
2 and Video (Al 2V), and that it will be appended to the 
Edit List 36 at time 10:00:00:00 in the Edit List 36 frame 
of reference. 

The third entry in the Text Timeline 35 indicates that 
45 at time two seconds, 2:00, there will be a dissolve, DISS, 
lasting sixty frames, 60F. to the B VTR which is to start 
at time 2:00: 1 2:03 in the B VTR frame of reference. This 
same information is shown in the background area 33 
by the white box with the crossed lines as diagonals. 
so Here the duration of the dissolve is shown with the no- 
tation "60f. 

The fourth entry in the Text Timeline 35 indicates 
that at time four seconds, 4:00, another source, E VTR, 
will PLAY starting at time 1 :23:05:23 in the E VTR frame 
ss of reference. This same information is shown visually in 
the layers area 32 on layer L2. 

The fifth entry in the Text Timeline 35 indicates that 
at time 4:00 the K'SCOPE (a Kaleidoscope special ef- 
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- fects device) is to play. The same event is shown in the 
layers area 32 on the layer below layer LI . the layer la- 
beled "KScV 

The sixth entry In the Text Timeline 35 Indicates that 
at time 5: 1 5 a TITLE-A will be KEYed in over an interval 
of 10 frames, 10F. This same information Is presented 
in the background area 33 by the dark bar with the di- 
agonal leading edge that is located above the timeline 
labeled 'B Vtr*. The diagonal edge indicates that the title 
dissolves in, with the length of the dissolve being repre- 
sented by the length of the diagonal portion of the bar. 
At the same time as the title is keyed in. 5:15, a new 
audio source, A3, is shown entering the recording by the 
entry RECD A123V. At time 6:00 the C VTR Is to start 
playing, and at time 7:20 its MOTION Is changed to 50% 
of normal playing speed. At time 7:10 audio source A3 
Is seen to end with the entry RECD A12V 

Referring now to the left side of FIG. 1, two video 
pictorial timelines 10 and 11 according to the present 
invention are visible. A main video pictorial timeline 10 
appears in the region that separates the upper left quad- 
rant and the lower left quadrant. A more detailed video 
pictorial timeline 11 appears above the main video pic- 
torial timeline, in the lower portion of the upper left quad- 
rant. These video pictorial timelines provide the operator 
with a sense of the image presented by the video se- 
quence. As will be further explained below, when a new 
video sequence is put into the video editing system of 
the present invention, a sample is taken of each frame. 
This sample is small, typically only eight pixels of infor- 
mation, but when these frame samples are assembled 
into a video pictorial timeline 10,11, this limited data pro- 
vides enough infomiation to visually cue the operator 
. quite effectively. 

The main video pictorial timeline 10 shown in FIG. 
1 represents a video sequence that can vary in length 
from a few seconds to an hour and a half. The desired 
scaling factor Is produced by duplicating or decimating 
the frame samples representing the video sequence so 
that a representative sample of the samples Is displayed 
in the video pictorial timeline 10. Immediately above the 
main video pictorial timeline 10 there is an associated 
main audio level timeline 22. As the name suggests, the 
audio level timeline 22 Illustrates the audio amplitude 
along the main video pictorial timeline 10 by displaying 
a single-sided "envelope" indicative of the amplitude 
level at each point In time. 

In either of the video pictorial timelines 10,11 or the 
simple timelines 21 in the Workspace 15 areas 32,33, 
clips can be taken from a longer video sequence by 
clicking a control button on the mouse or other cursor 
control device while the cursor 1 2 is on the mark In box 
26 to identify a starting point or the mark Out box 28 to 
identify an ending point. Reference marks 31 for per- 
forming time alignment between different pieces of vid- 
eo can be placed anywhere within a video sequence us- 
ing the Ref Mk box 30 or a corresponding key on the 
keyboard (66 in FIG. 2). 



Video window 14 displays the video image at the 
current location within any video sequence that is acti- 
vated, Including the composite video segments that are 
the result of an editing session. The video window 14 

5 displays the scene at the location of cursor 1 2 along the 
video pictorial timeline 10, whether it is still or moving, 
at normal speed or higher speeds. Immediately to the 
right of the video window 14 is a source status display 
34. Six VTRs, A through F, are listed as sources, with 

^0 squares shown to the left of those that are stopped. 
Sources that are playing forward at normal speed, such 
as the B source, are indicated with a ">" pointing to the 
right. A "»" indication signifies fast fonward, while a "«" 
indication to the left, as Is shown for source A, Indicates 

75 fast rewind. Below the list of sources there is a RECord 
box 37. a Pre View box 38 and a palette of most used 
transitions 39. Clicking the control button on the mouse 
while the cursor 1 2 is positioned on the RECord box 37 
causes the activity represented by all of the active layers 

20 in the layers area 32 and the background area 33 to be 
recorded into the recording medium. Clicking on the 
PreVieW box 38 causes a "virtual edit" of the active lay- 
ers to be previewed as a composite sequence but not 
recorded. I.e., be nnade visible In the video window 14 

2S as they would appear if recorded. Clicking on either the 
"30" (frames) box or the "60" (frames) box in the palette 
of most used transitions 39 allows the user to drag a 
transition of that length to the location of his or her 
choice in the Workspace 15 areas. 

30 The content of the main video pictorial timeline 10 
changes to reflect whichever video sequence has most 
recently been identified as the current active one by the 
operator clicking the control button on the mouse 70. 
The current active video sequence can be designated 

35 either by clicking on Its source in the status area 34 or 
on its simple timeline 21 in the Workspace 15 areas 32 
or 33 in the upper-right quadrant or by the use of keys 
on the keyboard. The main video pictorial timeline 10 
can display active video sequences that are a single clip 

40 of video or, when the preview (PVW) box 38 is clicked 
on, the main video pictorial timeline 10 can display a 
composite sequence of video that has been virtually ed- 
ited into a single sequence in one of the work areas 32 
or 33, as was explained above. . 

45 The user's movable cursor 12 can be locked onto 
one of the cursors (also 12 in this Figure) that are per- 
manently associated with the main video pictorial time- 
line 10 and the detailed video pictorial timeline 11 by 
moving the movable cursor over the associated cursor 

so and clicking the control button once. The user's movable 
cursor can be unlocked from the cursor 12 associated 
with one of the video pictorial timelines 10,11 by clicking 
the control button twice. 

While the user's movable cursor 1 2 is locked to one 

55 of the cursors associated with a video pictorial timeline 
1 0 or 11 , moving the cursor 1 2 causes one of two results, 
depending on whether the mass storage means (item 
50 in FIG. 2) is linear, such as a conventional video tape 
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- recorder, or random access, such as laser discs or mul- 
tiple hard discs. As will be furtlier described with refer- 
ence to FIG. 5, if the system's mass storage means 50 
is linear, moving the cursor 1 2 faster than the linear stor- 
age means can move the video tape causes a second 
cursor (13 in FIG. 5) to appear. The second cursor 13 
shows the actual VTR position on the tape, while the 
cursor 12 under the operator's control represents the 
desired tape position. When the cursor 12 stows down 
or stops, the other cursor, representing the actual posi- 
tion, moves to catch up with the desired position at the 
maximum speed of the linear storage means 50. If the 
system's mass storage means 50 is random access 
memory of some kind, no second cursor appears when 
the cursor is moved rapidly and the video window 1 4 
reflects the cursor 12 position almost instantaneously. 

If the user clicks the mouse 70 button while the cur- 
sor 1 2 is on the main pictorial timeline 1 0, but not on the 
cursor 1 2 associated with the main pictorial timeline 1 0, 
the cursor 1 2 associated with the main pictorial timeline 
10 becomes a current position cursor 1 3 and the cursor 
12 at the position determined by the mouse 70 becomes 
a desired position cursor 1 2. If the mass storage means 
50 is random access, the current position cursor will al- 
most instantaneously move to the desired position and 
the image at that location will be displayed in the video 
window 14. If the mass storage means 50 is linear, e.g., 
VTRs. the current position cursor 13 will move toward 
the position of the desired position cursor 1 2 at the max- 
imum speed of the VTR and the Images along the way 
will appear in the video window 14. 

The more detailed video pictorial timeline 11 directly 
above the main video pictorial timeline 1 0 is part of a 

. "machine control window". The other parts of the ma- 
chine control window are the reverse motion area 18, 
the forward motion area 20 and the desired position cur- 
sor 12. The detailed video pictorial timeline 11 contains 
a four second interval of video, with each video frame 
sample shown two pixels wide for clarity A machine 
control window audio level timeline 23 shows the ampli- 
tude of the audio associated with the video shown in the 
detailed video pictorial timeline 11 . A time mark 31 seen 
above the machine control window audio level timeline 
23 marks a particular location in the detailed video pic- 
torial timeline 1 1 and its associated machine control win- 
dow audio level timeline 23. 

The machine control window permits the operator 
to scroll slowly through individual frames of the currently 
active video sequence, whether the storage is linear or 
random access (non-linear). It Is used for fine control to 
Identify and mark individual frames in the video se- 
quence with time marks 31 for use in time aligning dif- 
ferent video sequences. As the desired position cursor 
12 is moved along the detailed video pictorial timeline 
1 1 , its motion is reflected in the content of the video win- 
dow 14 and in the position of the cursor 12 associated 
with the main video pictorial timeline 10. although it 
should be noted that the motion of the latter may be 



nearly imperceptible, depending on the scale factor of 
the main video pictor'al timeline 1 0 and how that relates 
to the view provided by the detailed video pictorial time- 
line 11 in terms of the ratio of their time scales. 

s To access a location that is beyond one of the ends 
of the detailed video pictorial timeline 1 1 . the desired po- 
sition cursor 1 2 is moved past that end. Moving beyond 
the ends of the detailed video pictorial timeline 1 1 caus- 
es the detailed video pictorial timeline 11 and its asso- 

10 elated audio level timeline 23 to start moving In the op- 
posite direction to bring the desired location Into view. 

If the movement of the desired position cursor 12 is 
into the reverse motion area 18 to the left of the video 
pictorial timeline 1 1 , the video image in the video window 

75 goes into reverse motion as the scenes represented by 
the frame samples in the detailed video pictorial timeline 
11 stream to the right. Conversely, if the movement of 
the desired position cursor 1 2 is into the forward motion 
area 20 to the right of the detailed video pictorial timeline 

^0 11, the image in the video window 1 4 fast fonwards and 
the scenes represented by the frame samples in the de- 
tailed video pictorial timeline 11 stream to the left. 

The speed of these forward and reverse motions 
depends on how far beyond the ends of the detailed vid- 

25 eo pictorial timeline 1 1 the movement takes the desired 
position cursor 12. When the desired position cursor 12 
reaches the outside end of either of the motion areas 
18.20, the physical tape speed is maximum in that di- 
rection. As the magnitude of this attempted nrravement 

30 increases, an indicator (to be further described in con- 
nection with FIG. 5) fills the forward motion area 20 or 
the reverse motion area 18 in proportion to how fast the 
video sequence is moving relative to Its maximum 
speed. When this indicator fills the fonArard or reverse 

35 motion areas 20 or 18, the velocity of the video se- 
quence movement is at its maximum value. 

When the operator wants to slow down or stop the 
motion of the video sequence through the detailed video 
pictorial timeline 11 , he uses the mouse to move the de- 

^0 sired position cursor 1 2 back towards the detailed video 
pictorial timeline 11 portion of the machine control win- 
dow display, thereby slowing the velocity of the video 
sequence motion. Completely returning the desired po- 
sition cursor 1 2 to the detailed video pictorial timeline 1 1 

45 stops the motion of video sequence entirely 

Referring now to FIGS. 2 and 3, the frame samples 
17 that make up video pictorial timelines 10 and 11 are 
produced by a digital video and audio processor 58 and 
stored in a local memory 60 that is convenient to the 

so graphic interface display generator 57. As will be further 
described below, time marks 31 and single video frames 
1 9 are also stored In the local memory 60. 

The underlying video frames 1 9 that the frame sam- 
ples 17 represent are stored remotely in mass storage 

55 means 50. The video frame samples 1 7 are stored with 
pointers to the locations of the corresponding video 
frames 19. These pointers, depending on the nature of 
the mass storage means 50, are either the SMPTE time 
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codes, or memory addresses or both. While the icons 
shown for the mass storage means 50 in FIG. 2 suggest 
VTRs, they in fact can be any other video storage means 
and are preferably high capacity random access mem- 
ory, such as multiple laser discs or magnetic hard discs. 5 

The artist or editor operator controls operation 
through a keyboard 66 and a mouse or other cursor con- 
trol device 70 while interacting with the CRT display 68. 
Keyboard commands are processed by the human in- 
terface logic portion of block 64 which also contains io 
manual controls. As will be further described below, 
most of the activity associated with the present Invention 
occurs within the graphic interface display generator 57, 
the digital video and audio processor 56 and window 
and screen display generator 62. These interact with to- is 
cal memory 60, cursor control device 70 and the CRT 
display 68 to effect most of the behaviors associated 
with the invention. 

Operator input from the keyboard interacts with 
manual control human interface logic 64 to produce de- 20 
sired effects in the editor logic and automatic control 
software 54. The video source interface 56 Interacts with 
the editor logic and automatic control software 54 and 
the manual control human interface logic 64, receiving 
instructions from them and returning status information. 2S 
Responsively to these instructions, the video source in- 
terface 56 controls access to the contents of the mass 
storage means 50 via selecting means for video sources 
52. The selecting means for video sources 52 stores 
(and retrieves) timecode and control data and video and 30 
audio Infomriation in (and from) the mass storage means 
50. The video source interface provides identification of 
the video source, the current video frame data and the 
timecode range to be displayed to the graphic interface 
display generator 57. The graphic interface! display gen- 3S 
erator 57 controls the window and screen display gen- 
erator 62 to produce the display on the CRT display 68. 

Referring now to FIG. 3. the digital video and audio 
processor 58 produces a frame sample 17 for each vid- 
eo frame 1 9, and sends these frame samples to the local 40 
memory 60. In one embodiment, each frame sample 17 
that Is taken consists of eight individual pixels distribut- 
ed vertically along the center of the video frame 19. In 
another embodiment, the frame sample 17 consists of 
eight composite pixels that each represent the average 45 
video values within eight different regions distributed 
verticallyalongthecenterofthevideo frame 19. In either 
case, these frame samples 17, when displayed in se- 
quence as a video pictorial timeline, represent an 'edge 
view" of the contents of the underlying video sequence, so 

Other methods of producing the frame samples 17 
are envisioned. One of these requires considerably 
more processing, but provides the operator with an even 
more intuitive feel for the activity occurring within the vid- 
eo sequence being represented. This approach relies ss 
on an algorithm to identify the most dramatic features of 
the luminance and chrominance values found In a frame 
19 and emphasize those in the edge view representa- 



tion. Even when these frame samples 17 are the result 
of sophisticated processing and communicate more 
content to the viewer, they are very small in terms of the 
data required compared to the data content of the video 
frame 19 that they represent. 

Audio recordings that are input to the system, 
whether or not they are directly associated with a video 
recording, are processed to produce audio envelopes 
22,23 that provide a visual representation of the audio 
activity over time. The data required to reconstruct these 
audio envelopes is also stored in the local memory 60. 
Audio is sampled 60 times per second and stored as 
eight bits of data. The audio envelope data is also stored 
with pointers to where the underlying audio is stored in 
the mass storage means 50 (FIG. 2). 

The video source interface 58 contains a pictorial 
timeline generator 59 and a current tape/source position 
detector 55. The video source interface 58 receives 
source identification and zoom control (time range to be 
displayed) input from the human interface logic 64 and 
timecode, video and audio information from the mass 
storage means 50 (both shown in FIG. 2). Based on the 
zoom control information, the pictorial timeline genera- 
tor 59 determines how much the video frame sample 
record must be decimated for display Changing the 
zoom control alters the dynamic range of the video pic- 
torial timeline 10 from ninety minutes to a few seconds. 
It also correspondingly changes the detail that can be 
seen as a result of the video frame sample decimation 
that must occur to provide room for the longer times. 

The current tape/source position detector supplies 
the graphic interface generator 57 and the pictorial time- 
line generator 59 with information about the current po- 
sition on the video tape or other source. The pictorial 
timeline generator 59 controls which video pictorial time- 
line 10,11 and audio level timeline 22,23 data the local 
memory 60 is to supply to the graphic Interface gener- 
ator 57. Using the current tape/source position informa- 
tion provided by the current tape/source position detec- 
tor 55 and the pictorial timeline data supplied from the 
local memory, the graphic interface generator 57 oper- 
ates through the window and screen display generator 
62 to create the video pictorial timelines 10 and 11 and 
the audio level timelines 22 and 23 on the CRT display 
68 (FIG. 2). 

FIG. 4 is a block diagram representation showing 
how cursors 12, 13 and time marks 31 are produced and 
applied to the video pictorial timelines 10 or 11 . As par- 
tially described above, one cursor 1 2 is controlled by the 
operator to indicate the desired position on the video 
sequence, while a second cursor 1 3 indicates the actual 
position of a video tape recorder or other linear mass 
storage means 50 on the video tape or other medium. 

The operator controls cursor 12 via the mouse 70 
or other cursor control device and the user's cursor gen- 
erator 72. A cursor position detector 74 monitors the cur- 
sor 12 position and provides timeline position compara- 
tor 76 with the user's cursor 12 position. The timeline 
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. position comparator 76 also receives current position on 
the timeline information from the timeline current posi- 
tion location detector 61. By comparing these two in- 
puts, the timeline positton comparator 76 is able to gen- 
erate position error information. A timecode translator 
77 converts the position error information from the time- 
line position comparator 76. which Is in the frame of ref- 
erence of the CRT display (68, FIG. 2), into desired lo- 
cation changes in timecodes which are in the frame of 
reference of the stored video. These desired changes 
are then provided to the video source interface 56 which 
sends a corresponding motion command to the VTR or 
other source. 

The video source interface 56 receives timecode 
and status information from the VTR or other source. 
This current source position information is detected by 
the current tape/source position detector 55 within the 
video source interface 56 which supplies it to the time- 
line current location detector 61 and to the graphic in- 
terface generator 57. The timeline current location de- 
tector 61 supplies current position on the timeline infor- 
mation to the timeline position comparator 76, as men- 
tioned above, and to the cursor generator for source po- 
sition 80. The cursor generator for source position 80 
produces the current position cursor 1 3 on the CRT dis- 
play 68 at the location indicated by the current position 
on timeline information. 

In addition to the current source position information 
mentioned above, the graphic Interface generator 57 al- 
so receives time display range (zoom) information and 
"Mark" command information from user input. When a 
mark command is received, the graphic Interface gen- 
erator 57 produces a time mark 31 at that location. This 

. time nnark 31 is stored in the local memory 60 along with 
the frame samples 17 that constitute the video pictorial 
timelines 10,11 so that future video pictorial timelines 
will includethistime mark 31 at this location. The graphic 
interface generator will continue to generate a time mark 
31 at the stored location until it receives a delete com- 
mand (not shown) while the cursor position detector 74 
is indicating the position of this old mark. 

FIG. 5 is a block diagram representation that shows 
how the machine control window operates. A desired 
position cursor 1 2 is controlled using the mouse or other 
cursor control device (70 in FIG. 4) and the user's cursor 
generator (72 in FIG. 4). This cursor position is moni- 
tored by the cursor position detector 74. The output of 
the cursor position detector 74 is monitored by a variable 
rate detector 86. Based on whether the desired position 
cursor 1 2 is in the reverse motion area 1 8 or the fonward 
motion area 20 and how far into one of those areas the 
desired position cursor is, the variable rate detector pro- 
duces fonward and reverse velocity control signals that 
inform the video source interlace 56 and the variable 
rate icon generator 88 as to the user's desired velocity 
The video source interface 56 in turn produces fonward 
and reverse rate commands to control the actual mass 
storage medium tape or other source. 



The variable rate Icon generator 88 generates ei- 
ther a reverse variable rate Icon 89 or a f onward variable 
rate icon 90, depending on the direction and rate of de- 
sired motion. In the example shown in FIG. 5, the re- 

s verse variable rate Icon 89 has grown larger toward the 
left to fill part of the reverse motion area 18 In proportion 
to the amount of the maximum available reverse velocity 
that is being used. In this example, the size of the re- 
verse variable rate icon indicates that about 40% of the 

10 maximum available reverse velocity is being used. 
When fonward motion is involved, the fonward variable 
rate icon 90 operates In the same way, extending to the 
right to fill the forward motion area 20 in proportion to 
amount of the maximum available fon^ard velocity that 

IS Is being used. 

As the current location along the active video se- 
quence changes, the detailed video pictorial timeline 11 
produced by the graphic interface generator 57 moves 
beneath the current position cursor 13 to keep it posi- 

20 tioned over the current location. To accomplish this, the 
graphic interface generator 57 needs information indic- 
ative of the current position and the timecode range, so 
that it can ascertain which frame samples (1 7 in FIG. 3) 
it must retrieve from the local memory 60 in order to pro- 

25 duce the correct detailed video pictorial timeline 11. It 
receives the current tape/source position information 
from the current tape/source position detector 55 within 
the video source interface 56. 

While the foregoing discussion concerning the op- 

30 eration of the desired position cursor 1 2 in the machine 
control window has referred to the motion of the cursor 
1 2 into the fon/vard and reverse motion areas 20 and 1 8. 
that motion need not actually occur. In one implemen- 
tation, when the mouse 70 is moved in a way that would 

35 cause the cursor 1 2 position to go beyond the edge of 
detailed video pictorial timeline 1 1 , the apparent position 
of the cursor 12 stops at that edge and yet the virtual 
motion of the cursor 12 can still be detected from addi- 
tional real motion of the mouse 70. 

40 FIG. 6 shows an alternative embodiment of the ma- 
chine control window input mechanism. In this embodi- 
ment, the desired position cursor 1 2 Is controlled by con- 
trol knob 81 Instead of a mouse or other cursor control 
device 70. As before, when the desired position cursor 

4S 1 2 is moved back and forth along the detailed video pic- 
torial timeline 11 , the current position cursor 1 3 follows 
and the frame selected is displayed in the video window 
(1 4 in FIG. 1 ). This motion of the desired position cursor 
12 within the detailed video pictorial timeline 11 is con- 

50 trolled by the motion of the control knob 81 as active 
knob position indicator 79 moves through a positional 
region 85. 

Sufficient counter-clockwise rotation of the control 
knob 81 takes the active knob position Indicator 79 out 
55 of the positional region 85 and into a reverse region 83, 
while sufficient clockwise rotation of the active knob po- 
sition Indicator 79 takes the active knob position indica- 
tor 79 out of the positional region 85 and into a fonward 
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- region 87. Maximum counter-clockwise rotation of the 
control knob 81 causes the desired position cursor 12 
to move to the left end of the reverse motion area 18 
and produces, as in the other embodiment, maximum 
reverse velocity of the VTR or other video storage de- 
vice. Similarly, maximum clockwise rotation of the con- 
trot knob 81 causes the desired position cursor 12 to 
move to the right end of the forward motion area 20 and 
produces maximum fonward velocity along the video se- 
quence. 

The velocity of the video tape machine is propor- 
tional to the rotational distance of the active knob posi- 
tion indicator 79 into the fonward or reverse regions 87 
or 83, with maximum rotation corresponding to the max- 
imum fonward or reverse velocity of the video tape ma- 
chine: 

V =^ * V 
*cur n max 
max 

where, 

Vcur is the current velocity, 

Vniax maximum velocity. 

Dgur is the current distance into the region, 

and 

Dmax maximum distance into the region. 

The software of the human interface system can 
know the rotational position of the active knob position 
indicator 79 by any of several means. If the knob 81 em- 
ploys a wire wound potentiometer, the output voltage in- 
dicating its position can be translated into a digital 
number by an analog-to-digital converter. Alternatively, 
the knob 81 can include an optical position encoder to 
provide a direct digital readout of its position. The logic 
required to interpret the digital knob position information 
is similar to that described for cursor position detection 
In connection with FIGS. 4 and 5. 

Ideally, the locations on the knob 81 between the 
positional region 85 and the fonward and reverse regions 
83 and 87 are provided with detents to give the operator 
a slight amount of tactile feedback as the transition is 
made from positional operation to velocity controlling 
operation. The knob 81 also has stops at the outside 
ends of the reverse region 83 and fonA^ard region 87. 

Another difference between the embodiment of the 
machine control window shown in FIG. 6 and the one 
shown in FIG. 5 is unrelated to the difference between 
using a control knob 81 rather than a mouse 70. and 
could be used with either embodiment. The reverse var- 
iable rate icon 89' and fon/vard variable rate icon 90' in 
this implementation are both static, whereas the ones 
described above were dynamic. Whereas the icons de- 
scribed above changed size, extending dynamically to 
indicate various velocities, the ones shown here do not 
change, but nonetheless still suggest the idea of in- 



creasing velocity by their sloped shape and the motion 
of the desired position cursor 12 along that shape. 

One more difference between FIG. 6 and FIG. 5 is 
that in the implementation shown in FIG. 6 the current 

5 position cursor 1 3 is disposed above the detailed video 
pictorial timeline 1 1 , rather than below it, as it was in 
FIGS. 1 , 4 and 5. In this implementation the current po- 
sition cursor 13 remains visible even when it catches up 
with the desired position cursor 12, whereas in the other 

10 Implementation, the two merge when they are aligned. 
Referring now to FIGS. 7A and 7B, we see two sim- 
ple timelines 21 -A and 21 -B extending horizontally 
along a time axis 24 and displaced vertically along a lay- 
ers axis 25. The operator desires to time align a point of 

15 timeline 21 -A with a point on timeline 21 -B. Using a cur- 
sor 12 positioned on timeline 21 -A near the location of 
what has now become the active time mark 27, the op- 
erator has previously pressed a control button or key to 
designate this particular time mark (which was formerly 

20 a "31 ") as the active time mark 27. When this designa- 
tion was performed, a vertical reference line 29 parallel 
to the layers axis 25 appeared at the location of the ac- 
tive time mark 27. The operator then "dragged" the ac- 
tive timeline 21 -A and the vertical reference line 29 to 

25 its present location using the mouse or other cursor con- 
trol device while holding the control button down. 

Since the reference line 29 now intersects timeline 
21 -B at a point which is closer to the time mark 31 on 
the left than It is to the one on the right or either end of 

30 the timeline 21 -B, when the operator releases the con- . 
trol button on the mouse (70 in FIGS, 2 and 4), timeline 
21 -A moves to the left along the time axis 24 to auto- 
matk;ally and exactly align the active time mark 27 on 
timeline 21 -A and the nearest time mark 31 on timeline 

35 21 -B. Note that for the purpose of time alignment, both 
ends of the timelines 21 are also treated as if they were 
time marks 31. 

In addition to aligning the timelines 21 and their time 
marks 27 and 31 on the screen, the software also makes 

40 note of the timecodes and offsets that will be required 
to access the underlying video sources for recording or 
previewing in a time-aligned manner The various 
means used by video editing systems for physically 
time-aligning video sequences, once the proper time- 

4S codes and offsets are known, is well known to those 
skilled in the video editing art. 

FIG. 8 shows how video pictorial timelines 16 can 
be used In conjunction with the simple timelines 21 in 
the same Workspace 15 area, such as the layers area 

so 32. This allows some of the video sequences to be seen 
with the extra visual cues provided by the video pictorial 
timelines 1 6, while other video sequences are shown by 
the simple timelines 21 that save space and allow room 
for more layers of video to be displayed. FIG. 8 also 

55 shows several inactive current position cursors 73. 
These are left behind at the last position viewed, when 
the user's cursor 12 is detached from the current posi- 
tion cursor 1 3 by double clicking of the control button on 
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- the mouse 70. 

FIGS. 9A and 9B are a simplified logic flow diagram 
of a portion of the operator interface of the video editing 
system of the present invention. Referring first to FIG. 
9A, at start up the screen, the graphics and the video 
window are initialized 100. The main loop of the program 
then waits 101 for a frame sync pulse. When the frame 
sync pulse is received, the graphics are refreshed and 
a new frame of video Is written 102 In the video window. 
The status of the machine (video source) is then polled 
and the current position timecode is stored 103. Key- 
board and menu commands are then processed 104 
and it is determined whether a new source has been 
selected 105. 

If a new source has been selected, 105-Yes, the 
new video is displayed 106 in the video window 14. A 
new main video pictorial timeline 10 and detailed video 
pictorial timeline 11 are created 107 and 108. as de- 
scribed in connection with FIG, 3. 

Following these steps, a determination is made 109 
as to whether or not the video tape machine or other 
video source is In motion. If no new source had been 
selected, 1 05-No. this determination 1 09 is made direct- 
ly after the determination of step 105. If the machine Is 
in motion, l69-Yes. the current position cursor Is updat- 
ed 110, as described in connection with FIG. 4, and then 
a determination is made as to whether or not the oper- 
ator is controlling the machine 11 1 . It the machine is not 
in motion, 109-No, the determination as to whether or 
not the operator is controlling the machine 111 is made 
directly, without updating the current position cursor 
110. 

If the operator is controlling the machine. 111 -Yes, 
the desired positipn cursor is updated 112 and a deter- 
mination is made 11 3 as to whether or not the desired 
position cursor is In one of the variable rate areas (for- 
ward motion area or reverse motion area). If the desired 
position cursor Is in one of the variable rate areas, the 
desired fon/vard rate of motion or reverse rate of motion 
is detected (86 In FIG. 5) and the detected rate of motion 
is converted to a command (56 in FIG. 5) to be sent 115 
to the VTR or other mass storage device (50 In FIG. 2). 
If the cursor was not in the variable rate area, 113-No, 
the desired fon/vard rate of motion or reverse rate of mo- 
tion is detected (86 in FIG. 5) and the detected rate of 
motion is converted to a command (56 In FIG. 5) to be 
sent 115 to the VTR or other mass storage device (50 
In FIG. 2). 

After the command is sent 115 to the mass storage 
device, if path 1 1 1 -Yes has been followed, or after it has 
been determined that the operator is not controlling the 
machine, 111 -No, a determination is made 116 as to 
whether or not the operator has marked a selection to 
create a time mark, as described In connection with FIG. 
4. If the operator has indicated a desire to create a time 
mark, 116-Yes. the mark is created 117 by the graphic 
interface generator 57 (FIG. 4) and placed in storage In 
the local memory 60 as described In connection with 



FIG. 4 above. 

Whether or not the operator has marked a selection, 
11 6- Yes or 116-No, a determination is made 118 as to 
whether or not the operator has Identified a time mark 

5 as the active time mark (27 In FIG 7A). If not, the graphic 
timeline positions are converted 127 to timecode values. 
If the operator has designated a new active time mark, 
11 8- Yes. a further determination 119 is made as to 
whether this is the first time through this loop since the 

TO Operator identified the point. If this is the first pass 
through this loop, 1 1 9-Yes, the closest mark on the same 
timeline is identified 120, the active time mark is high- 
lighted 121 and a the vertical reference line Is created 
121 through that mark. Following these 11 9-Yes activi- 

15 ties, or without perfomiing these tasks if this was not the 
first time through this loop, 119-No, operator input from 
the mouse is detected and responded to 1 22. This input, 
if it Is present, is the desired horizontal motion of the 
timeline and the marks and vertical reference line asso- 

20 dated with it. The response 1 22 Is to move the timeline, 
marks and vertical reference line according to the oper- 
ator Input. 

Next, it Is determined whether or not the switch on 
the mouse Is still active 1 23. If the mouse button is still 

25 depressed, 1 23- Yes, the program advances to decision 
block 127. If the mouse button has been released, 
123-No, a determination is made 124 as to which mark 
on another timeline Is closest to the vertical reference 
line associated with the active mark on this timeline. The 

30 selected timeline and its marks and vertical reference 
line are then moved 125 to be aligned with the closest 
mark on the other timeline, as shown in the transition 
from FIG. 7A to FIG. 7B. This new position Information 
for the selected timeline is then converted 1 26 to source 

3$ timecode values. 

The user interface is then polled to determine 127 
if the operator has selected either "record" or "preview" 
actions. If the operator has selected neither. 1 27-No, the 
program returns to the top of the main loop and waits 

^0 for the next frame sync pulse 101 . If either "record" or 
"preview" were selected, 1 27-Yes. then commands are 
sent 1 28 to play all of the sources that were active in the 
Workspace 15 at the times corresponding to their loca- 
tions in the Workspace, thus creating the desired com- 

45 btned video sequence. If the selected operation is "pre- 
view" 129, the video and audio are displayed only 130. 
If the selected operation is "record" 1 31 , the video and 
audio are recorded 1 32 to the master tape and the cor- 
responding data is added to the edit decision list (EDL). 

50 In either event, the program returns to the top of the main 
loop and waits for the next frame sync pulse 101. 

While a preferred embodiment of the present inven- 
tion has been shown and described, it will be apparent 
to those skilled in the art that many changes and modl- 

55 fications may be made without departing from the inven- 
tion in its broader aspects. For example, although the 
operator Interface for a video editing system of the 
present invention, has been described as a single inter- 
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* face with several variations, portions of it could be mod- 
ified for other uses and applied to those uses separately. 
The claims that follow are therefore intended to cover 
all such changes and nnodiflcations as fall within the 
scope of the invention. 



Claims 

1. A method for representing a video sequence visu- 
ally and in terms of its length, the method compris- 
ing the steps of: 

sampling (58) each video frame (1 9) of the vid- 
eo sequence to produce a frame sample (17) 
for each video frame; 

storing the frame samples (17) for the video 
frames in a local memory (60); 
displaying (68) the frame samples (1 7) as a pic- 
torial timeline (10,11,16) representing an edge 
view of the video sequence. 

2. A method according to claim 1 , wherein frame sam- 
ples ar^ displayed side by side and the sampling 
step comprises the step of: 

producing (58) for each video frame a plurality 
of pixels (17) that each represent an average video 
value within a corresponding region along the ver- 
tical axis of the video frame (19). 

3. A method according to claim 2, wherein the produc- 
ing step comprises the step of: 

emphasizing (58) a significant video feature 
within each region. . 

4. A method according to claim 1 , wherein the sam- 
pling step comprises the step of: 

selecting (58) a plurality of pixels (1 7) along a 
vertical axis of each video frame (1 9). 

5. A method according to claim 4, wherein the vertical 
axis is taken through a center of each video frame. 

6. A method according to claim 1 further comprising 
the steps of: 

storing a corresponding video sequence in a 
mass storage medium (50); 
providing with each frame sample a pointer to 
the video frame from which the video frame 
sample is produced; 

selecting a location (70, 1 2) within the video se- 
quence by indicating a frame sample from the 
pictorial timeline (10. 11, 16); and 
using the pointer from the indicated frame sam- 
ple to access the video sequence at the select- 
ed location (12). 



7. A method according to claim 6 further comprising 

the steps of: 

responding to operator instructions by rear- 
5 ranging an order in which the frame samples 

(17) are displayed (68); and 
outputting an edited video sequence according 
to the operator rearranged order of frame sam- 
ples (1 7) using the pointers to the video frames 
10 (19). 

8. A method according to claim 6 further comprising 
the step of: 

providing (70,12) a view (14) into the stored 
IS (50) video sequence. 

9. A method according to claim 1 further comprising 
the steps of: 

20 sampling (58) an audio signal to produce a plu- 

rality of audio samples which represent an en- 
velope (22, 23) of the audio signal; 
storing the audio samples in the local memory 
(60); and 

25 displaying (68) the audio samples together with 

the pictorial timeline as a visual representation 
of the envelope over time. 

10. A method according to claim 9 further comprising 
30 the steps of: 

storing the audio signal in a mass storage me- 
dium (50); 

providing with each audio sample a pointer to 
35 a corresponding portion of the audio signal in 

the mass storage a medium (50). 
responding to operator instructions by rear- 
ranging an order in which the audio samples 
are displayed (68); and 
40 outputting an edited audio sequence according 

to the operator rearranged order of audio sam- 
ples using the pointers to the audio signals. 



45 Patentanspruche 

1; Verfahren zur visuellen und langenabhanglgen 
Darstellung einer Videosequenz, wobei das Verfah- 
ren die folgenden Schritte umfa3t: 

50 

Abfragen (58) jedes Videobilds (19) der Video- 
sequenz, um fOr jedes Videobild einen Bildab- 
fragewert (17) zu erzeugen; 
Speichern der Bildabf ragewerte (1 7) fur die Vi- 
55 deobilder in einem lokalen Spelcher (60); 

Anzeigen (68) der Bildabf ragewerte (17) als 
bildliche Zeitfolge (10, 11, 16), die eine Flan- 
kenansicht der Videosequenz darstellen. 
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. 2. Vertahren nach Anspruch 1 . wobei die Bildabf rage- 
werte nebeneinander angezelgt warden, und wobei 
der Abfrageschritt den folgenden Schritt unnfa3t: 

Erzeugen (58) einer Mehrzahl von Bildele- 
menten (17) fur jedes Videobild, wobei jedes Bild- 
element einen Durchschnitts-Videowert in einem 
entsprechenden Bereich entlang der vertikalen 
Achse des Videobitds (19) darstellt. 

3. Vertahren nach Anspruch 2, wobei der Erzeugungs- 
schritt den folgenden Schritt umfaGt: 

Hen/orheben (58) eines signlfikanten Vldeo- 
merkmals Innerhalb jedes Bereichs. 

4. Vertahren nach Anspruch 1 , wobei der Abfrage- 
schritt den folgenden Schritt umfa3t: 

Auswahl (58) einer Mehrzahl von Bildelemen- 
ten (17) entlang einer vertikalen Achse jedes Vide- 
obilds(19). 

5. Vertahren nach Anspruch 4, wobei die vertikale 
Achse durch einen Mittelpunkt jedes VIdeobilds ver- 
lauft. 

6. Vertahren nach Anspruch 1 , wobei das Vertahren 
ferner die folgenden Schritte umta3t: 

Speichern einer entsprechenden Videose- 
quenz in einem Massenspeichermedium (50); 
Bereitstelien eines Zeigers in Verblndung mit 
jedem Blidabfragewert, wobei der Zeiger auf 
das Videobild zeigt, aus dem der Videobild-Ab- 
f ragewert erzeugt wird; 

Auswahl einer Position (70, 1 2) in der Videose- 
quenz durch Anzeigen eines Bildabfragewer- 
tesausderbildlichenZeitfolge(10, 11, 16); und 
Einsatz des Zeigers aus dem angezeigten Blid- 
abfragewert zum Zugrift auf die Videosequenz 
an der ausgewahlten Position (12). 

7. Vertahren nach Anspruch 6. wobei das Vertahren 
femer die folgenden Schritte umtaOt: 

Ansprechen auf Bedleneranweisungen durch 

neue Anordnung einer Reihentolge, in der die 
Bildabfragewerte (17) angezeigt (68) werden; 
und 

Ausgabe einer aufbereiteten Videosequenz 
gemaf) der durch den Bediener neu angeord- 
neten Reihentolge von Bildabf ragewerten (17) 
unter Venvendung der Zeiger auf die Videobil- 
der (19). 

8. Vertahren nach Anspruch 6, wobei das Vertahren 
ferner den folgenden Schritt umfaGt: 

Vorsehen (70, 12) einer Ansicht (14) in die ge- 
speicherte (50) Videosequenz. 



9. Vertahren nach Anspruch 1, wobei das Verfahren 
ferner die folgenden Schritte umfaQt: 

Abtragen (58) eines Tonsignals zur Erzeugung 
5 einer Mehrzahl von Tonabfragewerten, die eine 

Hullkurve (22, 23) des Tonsignals darstellen; 
Speichern der Tonabf ragewerte in dem lokalen 
Speicher (60); und 

Anzeigen (68) der Tonabtragewerte in Verbin- 

10 dung mit der bildlichen Zeittolge als visuelle 

Darstellung der Hullkurve im zeitlichen Verlauf. 

10. Verfahren nach Anspruch 9, wobei das Vertahren 
ferner die folgenden Schritte umfa3t: 

15 

Speichern des Tonsignals in einem Massen- 
speichermedium (50); 

Bereitstelien eines Zeigers in Verbindung mit 
jedem Tonabf ragewert, wobei der Zeiger auf ei- 
20 nen entsprechenden Abschnitt des Tonsignals 

in dem Massenspeicher eines Mediums (50) 
zeigt; 

Ansprechen auf die Bedleneranweisungen 
durch neue Anordnung einer Reihentolge, in 
25 der die Tonabtragewerte angezeigt (68) wer- 

den; und 

Ausgabe einer aufbereiteten Tonsequenz ge- 
maB der durch den Bediener neu angeordne- 
ten Reihentolge der Tonabtragewerte unter 
30 Venvendung der Zeiger auf die Tonsignale. 



Revendications 

35 1, Proc6d6 pour representor une sequence vid^o vi- 
suellement et en termes de sa bngueur, le procede 
comprenant les etapes de : 

dchantillonnage (58) de chaque image video 
40 complete (1 9) dela sequence vid6o afin de pro- 

duire un echantillon d'image (17) pour chaque 

image vid6o ; 

stockage des 6chantillons d'image (17) pour 
les images vid^o, dans une m^moire locale 
4S (60) ; et 

affichage (68) des echantillons d'image (17) 
sous la forme d'une ligne de temps d'analyse 
d'image (10, 11, 16) repr^sentant une vue de 
bord de la sequence vid6o. 

50 

2. Proc^dS suivant la revendication 1 , dans lequel les 
6chantillons d'image sont affiches cote a cote et 
I'etape d'echantillonnage comprend I'etape de : 
production (58), pour chaque image vid^o 
55 complete, d'une plurality de pixels (17)qui repre- 
sentent chacun une valeur video moyenne ^ I'inte- 
rieur d'une region correspondante le long de I'axe 
vertical de I'image vid^o (19). 
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3. Proc6dd suivant la revendication 2, dans lequet 
r^tape de production comprend r^tape de : 

accentuation (58) d'une particularity video no- 
table ^ I'interieur de chaque region. 

4. Proc^dd suivant la revendication 1. dans lequel 
r^tape d'dchantillonnage comprend I'dtape de : 

selection (58) d'une plurality de pixels (17) le 
long d'un axe vertical de chaque image vid^o com- 
plete (19). 

5. ProcSdd suivant la revendication 4, dans lequel 
I'axe vertical passe par un centre de chaque image 
video complete. 

6. Proc6d6 suivant la revendication 1 . comprenant en 
outre les 6tapes de : 

stockage d'une sequence vid^o correspondan- 
te dans une memoire de masse (50); 
attribution, avec chaque 6chantillon d'image, 
d'un pointeur k I'image vid6o complete ^ partir 
de laquelle I'^chantilion d'image vid^o est 
obtenu ; 

selection d'une position (70, 12) ^ I'interieur de 
la sequence vid6o, par indication d'un 6chan- 
tillon d'image k parlir de la ligne de temps 
d'analyse d'image (10, 11, 16) ; et 
utilisation du pointeur de r^chantlllon d'image 
indlqu6, pour accSder k la sequence viddo k la 
position choisie (12). 

7. Proc6d6 suivant la revendication 6, comprenant en 
outre les stapes de : 

reponse ci des instructions d'op^rateur, par 
rearrangement d'un ordre dans lequel les 
echantillons d'image (17) sont affiches (68) ; et 
production d'une sequence video editde con- 
form6ment k i'ordre rearrange par Top^rateur 
des echantillons d'image (17), par utilisation 
des pointeurs aux images vid^o completes 
(19). 

8. Proc6de suivant la revendication 6. comprenant en 
outre I'etape de : 

incorporation (70, 12) d'une vue (14) dans la 
sequence vid^o m^morisee (50). 

9. Proc6d6 suivant la revendication 1 , comprenant en 
outre les 6tapes de : 

echantillonnage (58) d'un signal audio pour 
produire une plurality d'dchantlllons audio qui 
represented une enveioppe (22, 23) du signal 
audio ; 

stockage des echantillons audio dans la me- 
moire locale (60) ; et 



affichage (68) des Echantillons audio en com- 
binalson avec la ligne de temps d'analyse 
d'image, comme une representation visuelle de 
I'enveloppe dans le temps. 

5 

10. Proc^dE suivant la revendication 9, comprenant en 
outre les Stapes de : 

stockage du signal audio dans une m6moire de 

masse (50) ; 

attribution, avec chaque 6chantillon audio, d'un 
pointeur k une partie correspondante du signal 
audio dans la mSmoire de masse (50) ; 
reponse k des instructions d'opdrateur par 
rearrangement d'un ordre dans lequel les 
echantillons audio sont affich6s (68) ; et 
production d'une sequence audio editee con- 
formSment k I'ordre rearrange par I'operateur 
des echantillons audio, par utilisation des poin- 
teurs aux signaux audio. 
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Fig. 6 
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